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' An asymptotic series in Ramanujan's second notebook (Entry 10, Chapter 3) is concerned 

with the behavior of the expected value of 4>{X) for large A where A is a Poisson random 
, variable with mean A and 4> is a function satisfying certain growth conditions. We generalize 

this by studying the asymptotics of the expected value of 0(A) when the distribution of 
i^H ' A belongs to a suitable family indexed by a convolution parameter. Examples include 

' the binomial, negative binomial, and gamma families. Some formulas associated with the 

negative binomial appear new. 
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^ ! 1 An Asymptotic Series of Ramanujan 

a^ 

■ A version (modified from [2j) of Entry 10 in Chapter 3 of Ramanujan's second notebook reads 



^ I Theorem 1 Let (^{x), x G [0, oo), denote a function of at most polynomial growth as x tends to 

oo. Suppose there exist constants xq > and A> 1, and a function G{x) of at most polynomial 
growth as x ^ oo such that for each nonnegative integer m and all x > xq, the derivatives 
0(m)^2;) exist and satisfy 

^(™)(x 



<G{x)(-) . (1) 
Assume that there exists a positive constant c such that 

G(x) > e-^v^ (2) 

as X ^ oo. Put 



oo 



x^(j){k) 



k=0 



1 



Then for any fixed positive integer M , 

2M-2 n \ 

n=2 fc=[(n+l)/2j+l 

as X tends to oo, where \_{n + l)/2j denotes the integer part of [n + l)/2 and the numbers 
are defined recursively by 

bkk = 1, k>2; 
bkn = 0, n < k oic n > 2k — 2] 

bk+i,n+i = nbk,n-i + in- k + k<n<2k-l. 

This result may seem hard to penetrate at first glance. Its relevance, however, is easily 
appreciated through interesting examples such as ( [3] ) 

and 



^ ' A;! V" 8x 128x2 ' ^ \x 

k=0 ^ ^ 



oo 

-X 



^x'=log(fc + l) ^ , , 1 1 ^ / 1 A 

I — n \ / 



A:=0 

both valid as x ^ oo; by choosing (j){x) = logr(x + 1) in ([3]), an asymptotic formula for the 
Shannon entropy of the Poisson distribution can also be obtained (see [6J ) . 

The first goal of this note is a formal, probablistic derivation of Theorem [TJ The starting 
point is the observation that (pooix) = E(j){U), where C/ is a Poisson random variable with 
mean x and E denotes expectation. Based on this we present in Section 2 a more general 
version (Theorem [2]) of Theorem [1] by considering U distributed as some distribution other 
than the Poisson, e.g., a gamma distribution or a binomial distribution. As illustrations, we 
derive asymptotic expansions for digamma functions and for inverse moments of certain positive 
random variables. We prove Theorem [5] in Section 3. 

Noting that (pooix) = E(f){U) where U has the Po(x) distribution, we expand </>(f/) as a 
Taylor series 

^ n! 

n=l 

and formally take the expectation term by term: 

r..nr^ ^ '^'^(?7-x)"0(")(x) 

n=l 

The quantity = E{U — x)" is the nth central moment of the Po(x) distribution. The first 
few /i„'s are 

(^1, ^2, At3, /^4) = (0, X, X, 3x^ + x). 
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and they obey the well-known recursion (see [19], Lemma 3, for example) 

Ain+i = x \ + npLn-l I , n > 2, 
from which we obtain, by comparing the coefficients of ^""'^"''^ and using the definition of hkn, 

n 

/^n = ^6fcnx"-*^+\ n>2. (6) 

A:=0 

The double sum in ([3]) is the result of substituting Q in ([5]) and noting that 5^^ = if /c < 
[(n + l)/2j. Based on this it is also clear that ^„ is a polynomial in x of degree [f^/2J, which 
implies that, given the condition ([T]), the "leading term of the remainder" in ([5]), 

(2M-1)! ~ (2M-1)! 

is 0(G(x)x-^^). 

The above derivation is, of course, strictly formal. However, it can be made rigorous under 
the stated conditions; see Berndt [2] and Evans [5]. Berndt actually proved a modification of 
([3]) where the order of summation over k and n on the right hand side is inverted and certain 
higher order terms of the resulting sum are absorbed in the 0(G(x)x~*^) term. 



2 A General Version 

The formal derivation in Section 1 suggests that it is possible to generalize Theorem [1] if we 
let U have a suitable distribution other than the Poisson. Noting the key role played by the 
central moments of [/, we give a version of Theorem [1] by imposing conditions on the moment 
generating function (mgf) of U . An introduction to moment generating functions can be found 
in probability texts such as Gut [9]. A useful property is that, if an mgf exists in a neighborhood 
of zero, then for all m > 1, the mth moment exists and can be obtained by differentiating the 
mgf m times. 

Theorem 2 Let (j){x), x £ [0,oo), denote a Borel measurable function that can he hounded in 
ahsolute value hy a polynomial in x. Let M he a fixed positive integer. Suppose there exist a 
constant ^ > 1 and a function G{x) of at most polynomial growth such that for 1 < m < 2M 
and all sufficiently large x, the derivatives (j)^'^\x) exist and satisfy 



m! 



m 



<G{x)[-] . (7) 



Assume there exist r] £ (0, 1) and a constant B such that for all sufficiently large x, 

G{y) < BG{x) whenever \y — x\ < rjx. (8) 
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Let Q be an unbounded subset of [0,oo) and let Ux, x £ ^l, be a family of nonnegative random 
variables. Assume there exist a constant 6 > and a function g(s) such that for all x £ 0,, the 
mgf ofUx exists in the interval {—6,5) and satisfies 

Ee'U, ^ ^xgis) ^ 5). (9) 

Assume g'{0) = I in addition. Then 

2M-2 n \ 

E^iUx) = Hx) + E Cfc„x"-'=+i^-p + 0(G(x)x-^), (10) 

n=2 fc=[(n+l)/2j+l 

as X tends to oo, where Ckn o'^e constants that depend only on the function g{s), and are deter- 
mined by 

n 

E{Ux-xr = Y,(^knx''-''^\ n>2. 

k=0 

Evidently, Theorem [1] is the special case g{s) = — 1, except for the assumption ([8]) on 
G{x) which replaces ([2]). This new assumption does not appear very restrictive as we shall 
see from the examples later in this section; however it does make the proof of Theorem [2] more 
straightforward. We also relax the assumption on 4){x) slightly by requiring only 2M derivatives. 

It should be emphasized that the function g{s) in ^ does not depend on x. Also note that 
g{s) is analytic in s G (—(5, 5) given the existence of the mgf. Aside from the Poisson, examples 
of distribution families that satisfy ([9]) include the binomial, negative binomial, and gamma 
families. In general, suppose Yi,Y2, ... is a sequence of independent and identically distributed 
(i.i.d.), nonnegative, nondegenerate random variables whose mgf exists in a neighborhood of 
zero. Then the family of random variables {X]fc=i ^fci n = 1,2, . . .} (n is known as a convolution 
parameter) has mgf 

^exp (^^fy^^ =exp{nlog{Ee'^')) , n = 1,2,..., 

which is of the form ([9]) with g{s) = (EYi)^^ log (i?e*^^), if we index the family by its mean 
X = nEYi. This shows that Theorem [2] is potentially applicable to a wide range of problems. 

Example 1 For a fixed p £ (0, 1), consider the family U^, x = p, 2p, 3p, . . ., where has 
the binomial distribution Bi(n,p), n = x/p. The first few central moments of Ux are given by 
{q=l-p) 

(^2,Ai3,^4) = (^a;, {q-p)qx, 3q^x^ + q{l - Qpq)x). 
Since Bi(n,p) is a sum of n i.i.d. Bernoulli(p) random variables, Q is satisfied. 
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Given r (real) and a > 0, let </)(x) = G{x) = {x + a) ^ . It is easy to verify ^ and ([8]); 
thus we have 



I — n \ / 



-r-2 

yj^ jP'J {i^^uj ^ynp -t-U) -I yupjynp^u) 

k=Q 

(n — 'n\nr(r 4- ^^(r -I- 9] 

-{np){np + a) ^ 



6 

+ — ^ -{npy{np + a) * (11) 

o 

+ 0(n-'-3), 

as n ^ 00. 

If we let (j){x) = x~'^, X > 1 and (j){x) =0, x < 1, then we obtain an asymptotic expansion 
for 

A:=l ^ ^ 



by simply substituting a = in the right hand side of (jTT|) . When r is a positive integer, 
()12p is sometimes known as the rth inverse moment of the binomial. The problem of 
inverse moments has a long history in statistics (see, for example, Stephan [16] , Grab and 
Savage [8j, and David and Johnson [4]). More recently, expansions for (I12p have been 
considered by Marciniak and Wesolowski [H] (see also Rempala [15]) for r = 1, and by 
Znidaric [19] for general r. Znidaric [19] also gives a brief historical account with many 
references. 

A special case corresponding to r = —1/2 is 

which is the binomial analog of (|3|) considered by Ramanujan ([2]). 
Let 0(x) = log(x + /3) for a fixed /3 > and let G{x) = 1. We have (as n — > 00) 



E log(A; + /3) = log(np + p)-!^{np + (3)- 

k=o ^ ^ 



+ ^^-^^{np){np + /3)-3 - ^(npf{np + /3)-4 (13) 
+ 0(n-=^). 

The problem of approximating the left hand side of (jlSp appears in Krichevskiy [131 
information theoretic context; see also Jacquet and Szpankowski |101lllj. who give an alternative 
derivation of (jl3p using the method of analytic poissonization and depoissonization. Flajolet [7] 
also considers similar problems using singularity analysis. 



5 



Example 2 For a fixed p E (0,1), consider the negative binomial family NB(n,p) whose 
probability mass function is f{k; n,p) = {^~^^~^^p^q^ , = 0, 1, . . . , where q = 1 — p. The mean 
is nq/p and the first few central moments are 



'nq nq{l + 
(^2,At3,/^4) = o— 



6 1 (nq)^ 
3 + - + — ^ ^' 



n nq 



Similar to the binomial NB(n,p) is a sum of n i.i.d. geometric(p) random variables, ([U]) 

is satisfied and Theorem 2 is applicable for an appropriate (t){x). 



Take = {x + a) ^ , a > 0. We have, as n ^ oo. 



E 

fc=0 



n + k-l\ ^ = /^!^ ^ ' _^ ^(^ + ^ ) f ( '^1 

2p 



pV(A: + a)-'^ = ( ^ + a) + 



(1 + q)r(r + l)(r + 2) ^ nqX fnq^ 



p J \ p 



r{r + l)(r + 2)(r + 3) / nq 



nq 
p 



-r-2 



-r-3 



-r-4 



(14) 



+ 0(n-"-3) 



As in the binomial case, we obtain an asymptotic expansion for 

Y,(''^l~%^q^k-' 



k=l 



k 



(15) 



for real r by substituting a = in the right hand side of (|14p. Expansions for (jl5p have 
been considered by Marciniak and Wesolowski [14j and Rempala [15] for the special case 
r = 1, and by Wuyungaowa and Wang [18j for integer r > 0. 

• Let (/)(x) = log(x + P) for a fixed /3 > 0. We have 



fc=0 



+ ^ ~ -'-^ n fc i„ , ,3\ f ^1 , a\ I f nq\ f nq 



p-q^ log(fe + /?) = log ( f + /3 j - ^ j (^f + /3 



^(l+^^nq\ /nq^^ 
p J \ p 



-s? (7) (7-^1 



Example 3 Consider the gamma family Gam(x, 1), x > 0, whose density function is 
f{u;x) = n^~-'^e~"/r(x), n > 0. The mean is x and the first few central moments are 



{fi2,fJ'3,fJ'A) = {x, 2x, 3x^ + 6x). 
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The moment generating function is (1 — s) ^, s < 1, which is of the form ([9]) with g(s) = 
-log(l - s). 

Take (p{x) = G{x) = x\og{x). We have 

^ .log(„)u--e-" d„ = xlog(x) + ^ - ^ + O (MSl) . 

as X ^ oo. Noting T[x + 1) = xr(x), we may write 

^ ' - log(x) + — -—- + O , (16) 



r(x + l) ' ' 2x 12x2 V 

which is a famihar asymptotic formula for the digamma function ([Ij, p. 259). By expanding for 
one more term we can replace 0(x^^ log(x)) by 0{x~^) in (jl6p . A full asymptotic expansion can 
be recovered by applying pU|) and using the following recursion between the central moments 
of Gam(x,l) (see H?]): 

iUfe = (A; - l)(;Ufc_i + X;Ufc_2), k>2. 



3 Proof of Theorem [2] 

Our proof follows Berndt In the setting of Theorem [5] we have 

Lemma 1 Let h{u), u € [0, cxd), be a Borel measurable function that can be bounded in absolute 
value by a polynomial. Then for a fixed t G (0,1), both EI{Ux < tx)h{Ux) and EI{Ux > 
x/t)h(Ux) tend to exponentially fast as x tends to oo, where /(•) is the indicator function. 

Proof. Observe that xg{s), the cumulant generating function of Ux, is an analytic function of 
s (real) in a neighborhood of zero. Because g{0) = 0, g'{0) = 1 and t £ (0, 1), we may choose 
r, e > small enough such that both g{r) < r/t and g{r + e) < r/t. Since |/i(^i)| is bounded by 
a polynomial, there exists a constant D such that |/i(?i)| < e^^ + D for all u € [0, oo). We have 

\EI{Ux > x/t)h{Ux)\ < E{e'^^ + D)e'^(f^--^A) 

which tends to zero exponentially as x ^ oo. The proof for EI[Ux < tx)h[Ux) is similar and 
hence omitted. 

Proof of Theorem [2], Throughout we assume that x is sufficiently large. Define intervals 
Ii = [0, (1 — rj)x), I2 = [(1 — ri)x, (1 + r])x) and I3 = [(1 + ri)x, 00), where rj is as specified in 
(©• 

By Lemma [H both 

EI{Ux G hmUx) (17) 

and 

EI{Ux G h)HUx) (18) 
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tend to zero exponentially as x — > oo. 
Consider the Taylor polynomial 



2M-1 



Since for any y £ Ii, 



k=o 



2A/-1 



my)\ < E 



k=0 



k\ 



we have 

\EI{U^ G h)mx)\ < q{x)EI{U, G h). 

From ([7]) it follows that q{x) has at most polynomial growth as x — > oo; by Lemma [T] we know 
that 

EI{U., e iMUx) 



(19) 



tends to zero exponentially as x ^ oo. 
Similarly, for any y £ I^, we have 



2M-1 



my)\ < E 



and hence 



k=0 



2M~1 



\El{U^eh)mx)\ < E 



k=0 



A;! 



EliU, G h)Ul 



By LemmalU each of EI{Ux G /3)f/^, A; < 2M - 1, tends to zero exponentially as x — > oo. By 
([7]), each of (t)^^\x) has at most polynomial growth as x ^ oo. Overall 



EI{U, G h)mx) 

tends to zero exponentially as x — > oo. 

For any y G I2, there exists some point ^ between x and y such that 



(20) 



my)-Hy)\ 



<^(2M)(C) 



(2M)! 



|y - 



|2M 



<G(C) 



< 5G(x) 



(1 — 'q)x 



2M 



\y-x 



2M 



A 



2M 



\y - x\ 



\2M 



(1 — r])x ^ 

where ([7]) and ([8]) are used in the inequalities. Letting C = B[A/{\ — ?/)]^*^, we have 
\EI{U^ G hmU.) - < C^E\U^ - x\'^'. 
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We now consider the nth central moment of Ux, f^n = E{Ux — x)^, as a function of x. (Note 
that the mean of Ux is x as EUx = xg'{0) = x.) Expand xg{s) around s = to get 

Note that the coefficient xg^^\0) is the jth cumulant of Ux, and, according to the weh-known 
relation between central moments and cumulants (see [12] or [17J, for example) 

/^- = E(''"^)w^""'^(0), n>2, (21) 

with /iQ = 1 ^-nd fii = 0. Based on (pij) . it is easy to show by induction that /i„ is a polynomial 
in x of degree at most [n/2j, its coefficients depending only on the function g{s). Hence, for 
large x we have E{Ux — x)^*^ = 0(x*^) and 

EI{Ux G hMiUx) - m^)] = 0{G{x)x-^). 

Combined with the exponentially small items (jl7p . (jlSp . (jl9p and (j20p . this gives 

E[4>{Ux) - mx)] = 0{G{x)x-'^). 

It remains to calculate Eip{Ux)- We have, by the definition of Ckn, 

.„'^(")(x) 



n=0 

-fc+iy '(^) 



n=2 A:=0 



n! 

2Af-l n 

(x^ 



n! 

n=2 fc=[(n+l)/2j+l 
2Af-2 n ^ 

= '^(-) + E E C.nX"-'^'M^ + 0(G(X)X-^). 

n=2 fe=[(n+l)/2j+l 

Note that the inner sum over k is curtailed because the degree of fin is at most [n/2j, i.e., 
Cfcn = if /c < [(n + l)/2j. As a consequence of ([7]), the term corresponding to n = 2M — 1 in 
the outer sum is written as 0{G{x)x~^'^) in the last equality. The proof of (|lUp is now complete. 
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